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ABSTRACT 

The effects of dynamic quantum allocation and 
swap-time variability on central processing unit (CPU) behavior are 
investigated using a model that allows both quantum length and 
swap-time to be state-dependent random variables. Effective CPU 
utilization is defined tc be the proportion of a CPU busy period that 
is devoted to program processing, i.e. the time not spent in 
swapping. Using this measure computational results are derived for 
four cases: (1) both quantum and swap-time constant, (2) varying 
quantum and constant swap-time, (3) constant quantiim and varying 
swap-time, and (4) both quantum and swap- time varying. An allocation 
strategy that reduces the quantum as the number of tasks in queue 
increases proves superior to both a strategy that increases the 
quantum and to the common constant quantum strategy. Swap-Time 
variability is shown to have a more pronounced affect then quantum 
variability. (Author) 
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ABSTRACT 



The effects of dynamic quantum allocation and swap-time vari- 
ability on central processing unit (CPU) behavior are investigated using 
a model that allows both quantum length and swap-time to be state- 
dependent random variables. Effective CPU utilization is defined to 
be the proportion of a CPU busy period that is devoted to program 
processing, i.e. the time not spent in swapping. Using this measure 
computational results are derived for four cases: (1) both quantum 
and swap- time constant, (2) varying quantum and constant swap- time, 
(3) constant quantum and varying swap-time, and (A) both quantum 
and swap-time varying. An allocation strategy that reduces the quantum 
as the number of tasks in queue increases proves superior to both a strategy 
that increases the quantum and to the common constant quantum strategy. 
Swap-time variability is shown to have a more pronounced effect than 
quantum variability. 

Keywords: dynamic quantum alloctation, swap-time variability, effective 
CPU utilization, semi -Markov model, time-sharing system. 

^omputin^ Reviews categories: 4. 3. 



INTRODUCTION 



With a time-sharing operating system, a single program is given 
control of the central processing unit (CPU) until execution is com- 
pleted or a maximum time limit is reached. This time slice, called 
a quantum , is followed by a period during which the CPU is controlled 
by the operating system while control of the CPU is removed from c.a 
program and assigned to another. This duration is called the overhead 
or swap- time . 

A quite natural view is that the quantum represents a period of 
effective processing while the swap-time is a necessary but nonproductive 
time requirement. However, in a relatively heterogeneous environment, 
characterized by several program priority levels, the scheduling 
algorithms invoked to assign control of the CPU can become complex 
and time-consuming. A thorough explanation and summary of scheduling 
algorithms is presented in the text by Coffman and Denning [6]. 

The quantum length decision is typical of the trade-off situations 
so often encountered in the design of computer hardware and software. 
A prime consideration is the "single user illusion", i.e . the need 
to make each user feel that the complete capability of the computer 
system is available to him. The "single user illusion" suggests a 
relatively short quantum so that, even in a high demand situation, 
each program is being assigned the CPU rather frequently. A counter 
consideration, however, is the increased overhead incurred for transferr- 
ing CPU control. With a shorter quantum the proportion of a fixed 
time period devoted to overhead increases (since more swapping results). 
These two contrary considerations reflect the more general competitive 
views that we have termed the user and operator perspectives [1]. 



While the quantum length decision has been resolved typically 
by establishing a constant value that appears to work well over the 
varying demand periods and for the various user classes » an interesting 
possibility is to allocate varying length quantum dynamically. Con- 
sequently » the time for which a specific program controls the C?U can 
vary depending on the current CPU demand, i.e . the number of piograms 
in queue. Also of interest is the ability to vary swap-time as well. 

The model developed in this research explores the effect of 
dynamic quantum allocation on CPU behavior. Additionally, and even 
more significant, we note the change in CPU behavior stemming from 
swap-time variability. Computational results are included to illustrate 
the range of behavior for a hypothetical time-sharing system. 



QUANTUM ALLOCATION AND SWAP-TIME VARIABILITY 

Quantum allocation 

A benefit of allocating quantum of different lengths ir that higher 
priority programs are processed quicker than lovei ones. This of course 
benefits only a certain class of users. Adopting the operator's pers- 
pective, rather than the user's, what benefits are realized from the 
allocation of variable quantum lengths? Aside from the corequisite to 
the urer benefit, i.e . matching service to rf^*i more appropriately, the 
answer is hopefully an increase in the effective use of the CPU. Time- 
sharing system designers long ago recognized the wasteful overhead 
incurrsd when a few (say only two) CPU-dependent programs are seeking 
service. The accumulated overhead required for swapping the CPU be- 
tween only two programs represents an inefficiency that, if removed 



-3- 



by running each program to completion without swapping, can be avoided 
generally without a noticeable decrease In service. Another argument 
favoring variable quantum allocation Is that a large number of 
programs In queue can result from certain ones requiring excessive 
CPU time, and a means for correcting this situation Is to provide 
longer processing periods for each program. This strategy can affect 
the "single user illusion" detrimentally during a short period, but 
avoids a gradual deterioration in response time over a longer interval. 

Little is known about time-sharing system behavior under dynamic 
quantum allocation. Coffman [3] proposes two discrete time models 
that classify Jobs as requiring a single quantum or multiple quanta. 
In the summary of his paper, Coffman [3, p. 352] notes the need for 
generalizing the models "to include an arbitrary * quantum-function* of 
the number in the system." Heacox and Purdom [9] extend Coffman*s 
model to allow adjustment of the number of quanta given to a program 
based on the arrival rates of programs. Also, they assume a constant 
non-zero swap time; whereas Coffman considers swap time to be negligible. 

Chang [2] considers a case where different distributions of 
quantum length can be adopted under the assumption of a "look-ahead" 
capability, i.e . if the program is to complete its processing in the 
next quantum, its service time follows a distribution different from 
the usual. The assignment of a different quantum accomodati^s short 
debugging runs as the author mentions [2, p. 122]. 
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Swap time variability 

Swap time or overhead Is considered negligible in some models 
[4,5,11] and a constant value In others [9,13]. The amount of time 
required for switching CPU control from one program to another is 
quite dependent on the complexity of the algorithms used for 
scheduling and resource allocation. I.e . assigning disk space, tape 
drives, peripheral devices, etc . to a particular program. As the 
operating system attempts allocation of its resources to reduce 
the average processing tlroe per program, more time is required to 
determine the proper assignment. But even with less complex re- 
source allocation methods, the swap time for a single transfer of 
CPU control Is dependent on the number of programs In the system, 
l*e . with more programs seeking service, more comparisons must be made 
to determine the program assigned CPU control. 

The model 

We begin with the assumption of a single CPU that performs all 
tasks related to the swapping of programs. Our objective Is to deter- 
mine the effective utilization of the CPU under different conditions 
for quantum allocation and swap time. Effective CPU utilization (U) 
Is defined to be the ratio of the expected amount of actual processing 
time during a CPU busy period [1, p. 223] to the expected length of 
the busy period. I.e . 

U « E{total actual processing time} » 1 ^ E {total swap time} . 

E{busy period} E{busy period} 
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This measure — effective CPU utilization — should be distinguished 
from that used by Gaver [7, p. 424], which he calls CPU productivity 

CPU productivity = Eibusy period) 

E{busy period} + E{idle period) 

The CPU productivity measure, subsequently termed CPU utilization by 

Shedler [16] and Gaver and She .ler [8], is a measure of the expected time 

the CPU is processing programs during an expected operating period 

(this is denoted as the busy cycle [1]). Note that an idle period, 

i*e , CPU idleness, is defined to be that period during which no programs 

are seeking 5ervice (the system is empty) • 

By defining effective CPU utilization to reflect only the loss of 
time due to swapping, we have excluded some additional sources of CPU 
idleness. For instance, the case where the CPU is idle because all 
programs are completing I/O activities is ignored. In effect we ace 
counting only a portion of the time the system is in supervisor mode 
[15, p. 313] as contributing to a loss in effectiveness. This is 
justified since we wish to investigate the effect of quantum allocation 
and swap-time assumptions on the CPU behavior. Time required for tasks 
other than swapping might remain in an environment with no time-sharing, 
e.g . a serial batch operating system. Moreover, the time in supervisor 
mode not related to swapping is dependent on the individual prograa 
and the mix of programs rather than on decisions related to swap time 
and/or quantum allocation. 

We assume the following conditions: 

(1) a time-sharing system using some feedback discipline and 
to which programs are submitted via an input device, 

(2) N input devices potentially can access the CPU, i.e . sub- 
mit a single program at a time to the CPU, 

(3) demand for the CPU by a "free" input device is Poisson, i.e . 
for a "free" input device at time t 
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Priinput device demands the CPU during (t,t+dt]} 
« Xdt + o(dt), 

(4) the processing times of submitted programs are Independent, 
identically distributed negative exponential random variables 
with mean l/y, and 

(5) the probability of more than one event in the interval 
(t,t+dt] is negligible, i,e , o(dt). 

Now in the most general case the programs are processed in some order 
for a period of time that does not exceed the quantum, a positive 
value assumed by the random variable (where the subscript indicates 
a possible dependency on the number of programs currently seeking 
control of the CPU). If the processing of the program is completed 
within the quantum, it exits from the system; otherwise, the program 
surrenders control of the CPU to another program and remains to seek 
further service. In either case a swap time is incurred, with 
a random variable (again, possibly dependent on the number of programs 
seeking service) . Thus each program requires one or more processing 
periods (Q^+D^) , which are called tasks . 

Within a CPU busy pe..iod, let the completion of a task at de- 
fine the origin of observations of the process of task completions. 
Observations of the task completion process are marked by an ordered 
pair (tQ,JQ), (t^,J^), (t2,J2) where tp, t^, t2, ... indicate the 
time epochs, and Jq, J^^ record the number of programs in the 

system at the respective time points. Let Z^(i) be a random variable 
representing the task completion time for the task, conditioned on 
i programs seeking the CPU on completion of the (n-1)— task, i.e . 

for J --i 
n-1 

Z^(i) - - t^.i (n-1, 2,...). 
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th 



Then the time devoted by the CPU to the n — task (B^(t)) for specific 
realizations of and D^^, i.e . Q^^fl^^ given by 



-y(t-6 ) 

B,(t) = Pr{Z^(i)<t} = / 1-e 6.<t<6,+q., 



We 



6.+q,<t. 
1 ^1— 



denote the Laplace-Stieltjes (Lf) transform of dB^(t) by 3^(6) where 



Let 



6^(9) = e ^^dB^(t) 
Y^(x) = Pr{D^£x}, 



[Re(e)>0]. 



Then 



5^(9) = 0^(6) [y+Ge 



•(e+y)q, 



and the expected value of Z (i) is determined by 



E{Z^(i)} « - 3^(0) - 



where 



Before continuing we note that three special cases can exist for 
the general form given above for 3^(6). These cases relate to the 
assumptions with respect to quantum and swap-time: 

(1) constant quantum and swap-time, 

(2) constant swap-time, variable quantum, and 

(3) constant quantum, variable swap-time* 
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All four cases (the fourth considering both as state-dependent random 
variables) have physical significance in the modeling of time-sharing 
systems. 

In the first case, the effective utilization of the CPU (U) is 
determined simply as 

U = l- 6_ 6<n 

n 

(since the swap-time and quantum are both constant neither 6 nor r) 
is subscripted). The result in this case is developed in a paper by 
Kleinrock [1?], using an approach based on the expected waiting time 
of programs and assuming loss of the remaining portion of a quantum 
after a program's completion. The remaining three cases require a 
more extensive analysis which we develop in terms of the most general 
conditions, i.e . both swap-time and quantum assumed to be random vari- 
ables. Development of the initial relationships below is presented 
in more detail in previous papers [1,14]. 

As defined above the ordered pair (t^,J^) provides the information 
on the number of programs in the system just after the task completion 
epoch t^. The sequence {J^,Z^(i)} describes a semi-Markov procej>s 
with the distribution function for state transitions within the interval 
(0,x] for this process given by 

A,,(x) - Pr{J «j, Z (i)<x|j «i}. 
ij n n ' n-1 

For the case where Q^^q^^ and these transition probabilities anV 

determined as 
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f 



dA^^._^(x) = 



Me (e ) dx 6.< X <6. + q. 

1 1 



-AxJ-i+1 



•(e ) dx 6 



< X < 5 + 



dA,,(x) = \ 



i 



-X(6 



• h(6^+q^-x) i=l,2,.,,, N; i<j 



where h(z) is the Dirac delta function, i,e. 



h(z) - 



1 if z=0 



0 otherwise. 



In the more general case, with and as random variables, we have 



3^(6) - a^(e)[ii+eY^(e+y)] 



e+y 

where Y^(9) is the LS transform of the distribution function for terminal 
access during the quantum period, denoted by C^(y). Then 



(N-i\ /, -^x, , -Xx,N-j 
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Let ct^jO) be the LS transform of dA^j(x), i.e. 



ct^j(e) "J*^ e dA^j(x), Re(e)>0. 



-ex. 



Then from above we have, after some simplifications, 



:;nd 



j-i+1 



l-Y^[e+y+A(N-i)] 



e+y+A (N-i) 



l-Y^[e+y+(N-j+k-l)A] 
e+y+(N-j+k-l)A 



• Yi[e+y+(N-j+k)A] j>i 

constituting the LS transforms of the transition probabilities for the 
subdiagonal and general terms respectively. 

Now, consider the process {J^, n'=0,l,2* • • }. It is a finite Markov 
chain with state space {O, 1, 2, • • • ,N} . Further its transition probabilities 
are given by 



QdA^j(x) = a^j(O) 



which we denote as a^^ , 1 , j=0,l , 2 , • • • , N. Denoting the matrix of transition 
probabilities as >1, we obtain 
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whlch we partition accordingly 



A = 





ON 


'^lO j 




'^20 j 













From the theory of finite Markov chains [10], we know that the 
element of {I-H) ^ represents the expected number of visits of 
the process {j^} to state j before entering state 0 (which designates 
the end of the busy period), having started originally from state i. 
Whenever the process visits state j, it spends an expected length of 
time (6^ in swapping and v^ in processing) before the subsequent 
task completion. Thus we have 

{I-H)'^ (ri-6) « V 

where n is the vector of expected task completion rimes (determined by 
the values assumed by and D^) and v is the vector of expected processing 
times. The elements of the vector v are therefore obtained from the re- 
lation 

n-6_ = (i-^)v. 

Similarly the expected time devoted to swapping b^ is determined by 
6_ » (I-^)b . 

Note that the elements of v and b^ corresponds to the number of programs 
seeking control of the CPU at the initiation of a busy period. Extending 
our previous statement regarding effective utilization of the CPU to a 
vector, we have 

"i ■ ^i/^^i"*"^!) i-l,2,...,N, 
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COMPUTATIONAL RESULTS 

For computational comparisons we assume a system with ten peri- 
pheral devices accessing a single CPU. The mean access rate (A) is .005/ms 
and the mean processing rate (y) is .05/ms. Beginning with a constant 
swap-time of 10 ms and constant quantum of 150 ms, we derive the expected 
CPU utilization to range f rom 63*968 to 66*654 (all values given as per- 
cent utilization) . Beginning with values near 65 percent seems warranted 
with respect to current systems although these values can vary widely. 

The effect of choosing different constant quantum values is shown 
in Figure 1. By decreasing the quantum from 150 ms to 50 ms, a drop of 
approximately two percent effective CPU utilization is experienced. 
However, by increasing the quantum from 150 ms to 250 ms, no practical 
improvement is realized. To prefer 50 ms to 150 ms for an operational 
value requires some considerations of the user perspective, but that no 
advantage resides with the choice of 250 ms over 150 ms is obvious* 

By implementing dynamic allocation of quantum length, some interesting 
results can be observed. Figure 2 reveals that by varying the quantum 
value directly with the number of tasks in queue, we incur almost a 
two percent drop in effective CPU utilization assuming initially 
that the busy period begins with a single program in queue. This 
disadvantage is removed as the number of programs initially seeking 
CPU control increases, i.e . for heavy demand environments, no advantage 
is apparent in increasing the quantum with an increasing demand. 
However, by adopting the strategy of reducing the quantum with increasing 
demand we effect an increase in effective CPU utilization. Although 
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small, this increase is interesting since the strategy of reducing 
quantum length with increasing demand is also beneficial to the user. 
In this instance at least the user and operator perspectives seem not 
to be competitive. Note that the average quantum length is the same 
in all three cases. 

Further investigation of the results presented in Figure 2 is aided 
by reference to Table 1. The components that determine effective CPU 
utilization are shown in Table 1, and although the increase in expected 
swap-time with reduced quantum length is evident, a more than compensat- 
ing increase in expected processing time is realized. 

Figure 3 shows the pronounced effec': of varying swap-time. In 
one instance, swap-time increases with the increase in demand, possibly 
reflecting the use of more complex scheduling algorithms with increased 
load. In the second case the swap-time decreases with demand, indicative 
of a contrary strategy — employing simpler scheduling algorithms with an 
increasing load. With either strategy aneffect is induced. Note that 
the average swap- time is the same in both cases (10 rrm) and equal to 
the value in the constant case (designated as c). The intersection of 
the three curves at a single point is interesting, but we can offer no 
obvious interpretation of this behavior. It might suggest that this 
is an inherently stable point of behavior, i.e . the value of effective 
CPU utilization which is insensitive to variations in swap-time strategies. 

Numerical results for the fourth model, the general case where both 
swap-time and quantum length vary , of fer little new information. The 
dominance of the swap-time is confirmed, and the dynamic allocation 
of quantum exerts only a minor effect. Again, the allocation strategy 
for both swap-time and quantum is constructed to produce average values 
of 10 ms and 150 ms respectively i 
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CONCLUSIONS AND SUMMARY 

Our investigation of dynamic quantum allocation and swap-time 
variability has led to the following conclusions, all of which are 
limited to the conditions specified for computational analysis: 

(1) With a fixed quantum strategy, at some point an increase 
in quantum length results in no practical improvement in 
the effective CPU utilization. 

(2) With a fixed swap-time, an improvement in effective CPU 
utilization can be realized by a strategy of decreasing 
quantum length with increasing demand. 

(3) The effect of swan-time variability on the effective CPU 
utilization is pronounced. 

(4) While the dynamic allocation of quantum seems attractive 

in concept, it seems to offer only a minor advantage in terms 
of effective CPU utilization. 

The fourth conclusion must be accepted only with respect to the operator 
perspective as reflected by the effective CPU utilization. For the 
user the advantage might be considerable. 

The models developed during this research offer tools that are 
both powerful and practical. Specific system configurations can be 
convenientJ.y investigated using the FORTRAN programs that produced the 
computational results. These programs are also being used to investi- 
gate further strategies involving both dynamic quantum allocation and 
swap-time variability. Extensions of this research are directed to- 
ward a more comprehensive sensitivity analysis and the identification 
of "best" strategies. 
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